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ABSTRACT , : 
This study investigates the relationship between 
college students' learning of grammar and mechanics and their ability 
to compose. A random sample of students enrolled in the University of 
New Mexico's freshman English program was tested ‘during three 
semesters. Several questions were addressed: Were the courses doing 
What they purported to do? What -were the trends in levels of- 
competence in grammar, mechanics, and writing? What were the | © 
connections between the learning of grammar and the ability to write 
competently? An analysis of test scores and judges" global ratings of 
students’ essays revealed that, past a certain level of instruction, 
studénts did not appear to make futher progress; this trend 
manifested itself sooner with the dearning of grammar and mechanics 
than with the actual production’ Of ‘writing. In addition, it was found 
that the acquisition of grammar and mechanics skills was only weakly 
correlated with improvement in writing, and then principally at the 
beginning of the students college careers. (KS) ; 
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Martin Bloom The Question 


Stine sequences of college Freshman English courses are bésed on an 
assumption ney if stydents can be taught to attgin some predetermined B 
level of competence in ager and" mechanics,’ they will write better prose. 


This seems sensible. , Students! must learn the tools, forms, and structures 


' of language before they can use these in their writing. Likewise, it could 


_be said that students will appreciate prose fiction, and non-fiction better 
if, they understand the author(s)" technical skills. Or, that learning must 
begin with small pieces and conned to larger yholas. 

It is also possible that this, basic assumption is wrong: Perhaps ac- 
quiring a formal knowledge of grammar and mechanics doesn't help students 
to write better--and is assailant a waste of both teachers' and students' 
effort. As part’ of a series of "research investigations* in English compo- 
sition at the University of New Mexica, we decided to.test this question 
empirically: What is ‘the relation between learning grammar abd mechanics 
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and the ability to write college compositions? Sgn 
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Sod aie peageite. the design and results of a pilot study ‘involving 
tito - panels: or. cohiodig of acl-| over a three-senester sequence. 


cede. 1 shows the cohorts.) 7 * , 


Nature of ‘the Sarees Stud 


; us "Freshman English. at UNM otnetsta of a seq ence of three courses. ‘ 


* 


‘Teference to _the Handbook. 


"English 100, writing Standard English, "1s a renedial course ‘required of 
“gu students who scored 18 or lower on the. CT test. It aims-to teach them 


to use grammar and mechanics according to fhe conventions of standard Eng- 


lish, and to write coherent, eiitdanana paragraphs.. The self-teaching, 


programmed text is Joseph Blumentahl's English,3200 
Brace, Jovanovich, 1972). This is ‘supplemented in c 


Corder's Handbook of Current English (Glenview, rl. 
. English 101, "Writing. with Readings ‘as Exposit on," is the pnly com= 


New York: Harcourt, 
ss by ‘Perrin and 


Scott, Foresman, 1974), 


position ‘course required of nearly all students. Requirements for admission 

are either an ACT score of 19-25 (students scoring o er 25 are exempt) or 

a grade of’ C or better in English 100.. This course focuses on writing ae 
essays of 250-1000 words in various modes » often st ulated by the readings ¢ 
‘inl Eschholz, Rosa, and Clark's La Language Awareness ( ew York: St. Martin's 


Press, 1974). ores and mechanics are discuased ormally, or with 


‘ 
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‘ English 102 _ “Writing with eaves in Literature," is upton for 


most students; about three-fifths of those who take 101 continue on in 102. 


a 


The emphasis lett is. on an enqneeesen to varied works" of dua gteatdee 
Tr ecatie of quality, and on critical analyses of literature aba the 
writing of 500-1500 word expository and argumentative essays: 

Heveatten we will simply sores to these. courses as "English. 100," 


* "101", or "102", ° , 7 7 ~ 
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Research Design 


- ae | During the fall of 1975 we selected a random sample of. 

' ‘students from the English’ 100 and 101 classes, and followed then — 
during the subsequent semester or two when they took the next 
‘courses in the Freshman English sequence (either 101 ox 102 or 

both). ‘Panel studies enable the researcher to look at the his-- , 
tory of a group of persons over time; but alsé to compare two 
differgnt groups at equivalent periods in-their training. Attri- 


tion ‘ was high, because many students postpone later courses in 


. — ~- Same ae . 
~\ we vr ore ee we Owe wel ewe 


the decline, or drop out’ of the University. (Of the beginning 
hundred students from riglisn 1005 fewer than a third were 
' - Dearie 102 two semesters later). 
We investigated several issues: ; 
1) Are. the Freshman English courses edhe what they “purport to . 
do? : : ; / 
2) What are the general trends in levels of competence in ‘gram * 
i ‘mar, mechanics, and writing, overtime? . 
|) : 3). What, if any, are the connections betwen. tia learning of z! 
| grammar and mechanics and the ability to write competent col- 
| , ‘Lege ‘compositions? _ 


%. 
We used a modified time series design? in which we rated 


. the students in each group at several different times over 
three semesters; this enabled us to compare scores in order to 


ae - identify patterns of change. We measured both the 100 and 101 
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or our own variations on then. 


. adapted the method of Godshalk, Swineford, and Coffman, ° in \*. 


cohorts for competence in grammar and mechanics at the begin-| 


‘ning and again at the end of the Fall 1975 semester, and once 


again at the end of the Spring, 1976 semester, 80 we could com- 
pare three time points. (See Fig. 2, comparisons between 1-2), 


2-3, 1-3, tc.) We also rated their’ essays at these times, as 
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well as at the end oF the Fall ‘semester, 1976. 
Measuring change in ieee ‘of traditional grammar and 
mechanics is fairly easy. because of the relatively high agree- Ny 


ment anonlg experts that a given usage is either "correot!-or ~*~ - -- 


——-— wwe, 


.incorreet” according to the rules. (Whether or not experts 


will agree on the rules is a different issue, not pertinent to 


"this study.) Thus, grammar tests may be constructed to sample 


the domain of rules and thereby to measure how well. students 
' d t 


understand them intellectually and baad application. We ¥ 
used either the tests of grammar and mechanics im English 3200 ” 
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Evaluating written paragraphs: or essays is more difficult 
because ‘objective standards of judgment are not agreed upon or 


uniformly applied.” Nevertheless, to assess the writing we’ | 


which a large number of jldges gave global (i.e., overall) 


ratings to a sample of each student's writings: l=inadequate, 


2=adequate, 3=superior. The sum of the judges’ scores divided 


by the number of judges produces a score that averages the var- 


iations in the judges' grading and approximates a "true" score 
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tter than,any one fudge might do. In this way, we could 


sign numbers to qualitative’ judgments \of -stu ental writings 
We e uld ‘infer 


he | impact of 


ore and after pat cet in writing. 


measure of validity/uhether the _ sooretppiroxiimates, Chat / 


“Ideally, an: essay's. "true" ia 


. which it purports to-measure. 
We app 
/ 


© would be the: average rating os all qualified judges. 
imated. the ideal by having each essay read by-at least five/ 
(but as many as.ten) qualified judges=-teaching fellows. and! ‘full- 


time, Englisi\Departnent faculty. .’ ti 

Before they began to rate. thesdy we attempted. to standard | 
_ ize the ratifgs (and thereby ‘to make the Measurements reliable) 
Here, each" reader independently | 


by holding a training session. 
evaluated ten essays of diverse qualities, and then compared 7 


evaluations and rationales with those of the other judges. 
These ratings appeared to be reliable, especially on the "in- . 
sdeguera® and "superior" essays, with | more variation on Nade~ 


quate" papers, but still within acceptable limits. ° 
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‘Results 
és 3 
; / a Figure 2 summarizes the data af the two grein ef stu- 


dents who began English 100 and lox in the Fall, 1975, and 

Seuainad in the_ Freshman Englich sequence for the duration 

of the research. To distinguish between them, we have used — . 
numbers to connect : the aa test ane from different times, 


and: aecee to — the 101 scores. The numbere/Letters 
s 
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tere when the tests were Sriduictedls.. . 


“The ‘tests. of grammar ‘and mechanics had a possible total 
of 100 points, while the wnjting | scores had a range of 2.00 : 
pointe (1.00 to as 00, or “inadequate to superior ratings). , 
’ The numbers of persons, who took each test are indicated in — 
; parentheses below the average scores." 
. Figure 3 sumnarizes the general “trends of these data by 
a form wifich helps us: to answer the questions we soued earlier. - 
6 First, are the courses doing what they purport. to be doing? 
Figure 3 identifies the group taking a given ness nd dis- 
criminates between the ‘two educational goule-the learning of 
wvtetan, and of .grammar and mecharlics. Notice that in Figure 
3 we distinguish between the two groups of students taking. 
‘oe English 101 and 102. We want to study the performance of — 
) these classes by comparing students who come directly into, 101 


with those who come to it from the’ remedial course, and like- 


e 


fo ” . 4 ° 
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wise for English 102...” 


English 100: The single group of wivdenks yho took this courge 
made. substantial gains in both writing, and ‘in grammer and 


a nen dal J 8 og i 
oe English 101 In 101, students who, had phauiblaty ‘taken 100 


improved any in. writing, but not. in grammar and mechanics. 


4, 3 . The students who went directly into 101 inbtoved substantially 
i | - in both wetting: and in . Grammar and mechanics. , : 
English 08 : NO’ changes occurred = the wetting of 102 students 
oa at * who previously "Sock? both 100 and’ 101. No data | were collected 
on their’ grammar ‘and aciutions* The 102 students who: had : 
ead previously taken only 101 (or Deen exempt from it) Aaiasisanved 
slightly in grammar and mechanics’ and in writing. 
Thus we “can make, these general statements about the learn- 
ing that ocourred in each of the Freshman Bngiish courses 
studied. English, 100 furs Mies its objectives, as did English ° 
102 (though more so for’ students who went directly ayes it 
7 "from high school rather than from English 100). English 102 
appgara to have accomplished none of its: objectives: in either 
uiivlng or in naintdining proficiency in grammar and mechanics. 
The second general question we asked concerned the trends 
2 in re and writing over time. In, order to pre- 
. “sent complex ‘data as sinply as possible, we offer Figure 4, 
; which graphs the dominant features of: ‘trends that ba aia when 


scores at one point are linked with scores at later Spkniba 


\ 


; ; 
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This masks the variations in individual learning ‘as. wet as 
relative score levels, but reveals the = trends. First, 
4 


' note-that the renedial students, reach plateaus in both gram- 


mar and writing. That is, it appears that past a certain 
level of Freshman English, these ‘students do not seem to make 


any progress. . This occurs sooner: with grammar and mechanics 


“than with.writing. Second, note that the writing levels of 


the students who tested. out of 100. improve in 101,' but drop 
slightly in 102.7 Likewise, the grammar scores of these regu- 


“lar students seem to deteriorate over time. This is paradox- ~ 


ical and leads: to our final: question. 
. What is’ the connection between .the learning of grammar’ 
and mechanics and the ability, to write effective Gbllege com- 


positions? This is a more difficult question to answer, but 
based on‘our reading of the pilot data, we must report that _ 


learning grammar and mechanics seems to be related only © 
weakly to improvement in writing, -and then principally at 
the beginning ‘of the students’ college career. At this time, 
presumably, instructors are explicitly enphasizing the fun- 


i damentals. 
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- ae? > Ve _ Implications, * ‘ 


This study ‘is a pilot project that followed the: samsition 


ty 


; of a small ‘umber of Freshman English students over. ‘a three 


4 ‘ semester. ‘period at the University of New Mexico. The research 


. 


“needs to ‘be replicated to determine “the soupdness of the data. 

However, these tentative results provide the impetus for . 2 
continued "ahdesnaent of the effectiveness of the curriciilu, 7 
They peinforde the courses that do appear to improve the stu- 


we ee 


_dents knowled, Be of rainer and ee or their aa a 


* 
ils. Tavis 


a 


nee ae : sdonte? This infomation has been of ‘help. in the planning for’ 
. analogous remedial courses in| echen euijaces ‘in, the: ‘University. 
Too often, the principal index of course abtucr tiene 
is student evaluations,® rather than some accurate, objective 


il meagure of what the ‘students have actually learned\ We hope, 


, therefore, that this research design may suggest to faadhers 
of Freshman English other ways in which they might measure 


the impact of tfeir own courses and curricula. ‘ ‘ 
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k = we wondered how rating the essays on a five-point: scale 
ate ge (equivalent of A-F) would compare with ratings on a‘three-point 
dies scale, | Would the more refined rating alter the scores ob- 
| tained, on the Lass refined scale? The same raters evaluated 
‘gis ite group of 102°(Fall, 1976) papers ‘on both scales, * 
with no appreciable differences in the ratings. 2 


. | ‘ 5 compare Campbell and Stanley's ‘discussion of alternative 
fe 


explanations ‘to a given result. (pp. 5-6). We’ should also 
note that Godshaik's original study considered variations 
; among ‘students' writings at each evaluation point; but we 
‘had-neither the time nor funds to eaneseet more than a single 
wo ee essay by each student at any lial evaluation point in our 


pilct. Beuay. , : : : : a 
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8 The numbers of students, involved in the later parts of . 
this study ‘diminished considerably. This is because of the 


“high: attrition ‘Of students” from 1000 Lot ada to 102,. either 


because of dropping. out, pa air, ia sequence, ‘with 161, on: 


4 
- \ - i, 7 


voluntarily postponing 102: - Vs 
‘ 4 \ 
Te are veminded of Albert . itaniben'etipressive Ds Dart- . 
mouth study which showed ‘thits students tend to retrogress . 
throughout ‘their college oe until by, graduation eine: _ es 


ee ee ee eo 
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he worse than ‘they did as” entering “freshmen. | 
See Themes, Theories, and Therapy: ‘The Teaching of Writing ie 
in College, (New York: McGraw-Hill, 1963), p. lll, ff, ae 


ry 


' bey ye ae . 
Buy own experience, as. Director of Ereshhan English and . 

reader of several aoa Student : ‘evaluations during. each 

of the three Semesters when we were ‘conducting this résearch,, 

js that these evaluationspwhether ‘eliciting "subjective” or 

"objective" conmentary-are almost uniformly favorable and wine 

discriminating. The students fpel pleased with their teachers ~ 

and often with the course-- fl frequently they woite their . 

evaluations in unspecific, abominable English, yesiate with us 

spelling and mechanical errorss In short, € ident evaluations’ ie 

are sub§ective and unreliable; they may reveal the students' ~ \ 
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state of mind, but — state of knowledge. . 


Figure 2 = 
. atts, 


j Seomeiny of results of UNM Pilot ha 
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(Fs and Nel ‘se Wasoo N=1O7 N2% 
Essays) 4 : oa Z - 


Writing 
Scores 


Nz l0OG 


pas CA ." ‘ Figure 2 


Summary of Results Presented as General Trends . 


Class and — “—~ Educational Goats : 
Student Backgrounds » Grammar Mechanics , Writing | 
‘ ! English 100 {remedial All gains this group - About half of all 
_ Zratmar, mechanics,. * .' achieved were made gains this group 
and paragraph writing), . 4. ,in-@#is class _ * achieved were made - 
, ; 3 . [see (1)-~-(2)] -- ° din this class ’ 
* ‘Taken primarily by ~ ve ee a “[sée (4)---(5)) 
_ ,8tudents who scored . © . : bs : 
o ~ 18 or, lower on ACT oer i 
° rs Ps i , 
English 191 (short ~ tf ‘ 
essay writing; some . . ’ 
grammar and mechanics , A , 7 
taught informally f 
and in#ermittently) ~~ Pg . 
a “Taken bY foruse * Slight deterioration About half of all 
oa . English 100 r occurred during this class gains this group 
‘ ---~ Students ; {sea (2)---(3)}  * achieved were madé 
: . Py we : in. this class 
ie R _ ; [see (6)---(7)] . 
— a 
Taken by students who All gains this All gains this 
_ went directly into’ group achieved ” group achieved 7 
- Efglish 101 by _ * were made in this + were made in this x 
scoring over 18 on class class . 
the ACT é [see (A)-—-(8) 1. {see (D)---(E)] : 
> ¥ ry = 
. English 102 (longer ‘- 1 “ 
essays based on works ‘ . * 
of literature; no 7 . in ‘ . ; 
foymal study of . “ , i 
. grammar or mechanics) ~ F 
ae e 
: Taken by former (no data collected) No change in 
. English 100 students = =§_—™ writing occurred * 
who also took is ‘ * in this class 
English 101 ae {see (7)-+--(8)] 
: Taken by students — Slight deterioration - ‘Slight. ap 
a ‘ + who went directly occurred during this deterioration 
‘ into English 101 and class ‘ occyrred during 
“a . who-took English the [see .(B)---(C)] this class 
‘, . following semester . [see Oi 
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Gross Trends in Scores of Student - 8 oe ts 

Cohorts’.in Grammar and Mechanics 
and in Writing* 


‘and Mechani@® 
Teste 


beginning end ends 
Eng. 100 Eng. 100 ‘Eng. 101 ‘ 


Writing 
Scores. | 
; | 
. beginning end end : end 
. an Eng. 100 Eng. 100 Eng, 10 Eng. 102 
Grammar . 


and Mechanics 
Tests 


vy ) : » 
_beginning -. 6nd end” ' 
ne Eng. 101 + EnggPl0l Eng. 102 


Writing 
Scores 
=? beginning end end . 
Eng. 101 Eng. 101 Eng. 102 
+ aR ; 
« tae 
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*Thest. graphs disregard relative levels on vertical axes so as to sities 


general trends. 


See data on Pigure 2 “= order to determine comparative 


ye? . 
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